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CONTROL OBJECT AND USER INTERFACE FOR CONTROLLING 

NETWORKED DEVICES 

FIELD OF THE INVENTION 

5 

The present invention relates generally to facility management systems such as home 
automation systems, and, more particularly, to an object oriented design software control 
object within such systems that provides for a logical representation and implementation of a 
network of physical devices. 

10 BACKGROUND OF THE INVENTION 

In the past, environments having networked equipment were typically limited to 
commercial and industrial sites. Such equipment was typically complex and highly 
sophisticated computer controlled machines that utihzed networks to coordinate 

15 manufacturing activities. However, unUke the commercial and industrial setting, the typical 
consumer setting included devices and appliances that were fairly unsophisticated and that 
were operated by a user on a one-to-one basis. To achieve the consumer device's specific 
function, the user had to physically interact with the device by, for example, pressing buttons 
on a coffee maker to preset the machine to turn ON at a specific time. 

20 Early advances in consumer devices and appliances were limited to remote control 

devices that, at first, were wired to the device, and later used infi-ared (IR) communications to 
transmit commands. However, the remote control devices still forced the user to interact with 
their respective devices on a one-to-one basis, hi addition, most hand-held remote control 
devices were proprietary, which required separate remote controllers for each consumer 

25 product. Further advancements included universal remote controllers that were capable of 
being programmed to control many consumer devices. However, universal remote control 
devices were limited in that they were typically not able to control devices other than 
entertainment equipment. 
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Lately, consumer appliances have become more sophisticated because of the decreased 
size and costs of computer-related components such as microprocessors. These new 
consumer devices include the so-called "smart" devices that, like the sophisticated 
commercial and industrial machinery, are capable of executing predefined tasks and capable 
5 of communicating over a network infrastructures. An example of a system is smart devices is 
CEBus®, which may utilize household powerlines to transport messages between comphant 
CEBus® household devices. CEBus® is implemented per EIA IS-60 for home automation. 
The CEBus® system utilizes controller and receptacle units to communicate and control 
CEBus® compliant devices. The receptacle units are connected to standard household 
10 receptacles and the command and control information is communicated over the powerlines. 
However, the CEBus® system is a hardware solution, which requires that the comphant 
devices be designed to be compatible with the standard. As a further limitation, the CEBus® 
controller is a special-purpose device. While this is an advancement over prior solutions, this 
hardware solution limits the upgradablity of the network and the devices, and fails to provide 
15 a solution for non-comphant smart devices. 

A further example of a system that is intended to network devices is Jini™, which is 
based on Java™. Jini™ uses Java Remote Method Invocation protocols to move code around 
a network of devices. Network services run on top of the Jini™ software architecture such 
that devices and applications may register with the network via a lookup service. However, 
20 the Jini™ system is limited in that each device must register with the lookup service for other 
devices to discover them. Thus, each device is not aware of other devices on the network 
without first pointing to the lookup service. Further, there is no general purpose user interface 
tliat enables a user to interact and control all of the networked devices from a remote location, 
hi view of the above, there is a need for a system whereby once isolated and non- 
25 remotely controllable and configurable devices are able to share information with and about 
each other, and are able to provide and accept common command, control, and 
communication though a network. There is also a need for a system that provides the 
networked devices with the abiUty to operate autonomously in the case of a network failure. 
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or for localized control and operation. There is also a need for a system that provides users 
with a method to control devices with a general purpose device (e.g., personal computer), and 
that provides a method to communicate over open network infrastructures. The present 
invention provides a solution to address the limitations and shortcomings of the prior art. 

SUMMARY OF THE INVENTION 

The present invention includes a set of software components and an application 
programming interface for the logical networked representation and implementation of a 
system of smart devices. The software components may be generally expressed as a control 
object component and a user interface component. The control object (CO) is a software 
object that may carry out communication, and accept and issue control messages. The control 
object allows a user to remotely control or query a physical device for which the specific 
control object has responsibihty and also maintains logical and physical connections and 
control of the device. 

The second component is the user interface, or consumer presentation display (CPD), 
which supplies a coherent and transparent interface across all network media and topologies. 
The user interface is capable of communicating with any control object that it identifies as 
being controllable in a given system. This communication may be across a logical network or 
may be local to a particular device. The user interface takes on the "personality" of the 
physical device for which the attendant control object carries a logical and physical mapping 
and control responsibility. 

In accordance with an aspect of the invention, the conti-ol object may be adapted to 
bind to any designed physical transport mechanism for communication with other control 
objects and is adapted to be embedded in a container apphcation and executed within a 
wrapper executable. In addition, the control object is preferably polymorphic, and thus is able 
to take on the logical attributes and command and conb-ol capabilities of any of the devices. 

The control object may be a component object model object (COM) that exists within 
the operating system. This preferably provides wrappers for exposed chents and enables the 



-4- 



MSFT-0021 
117834.1 



use of method calls and exposed properties by the operating system or other application 
software programs. The control object may include extensions such that the control object 
may logically and physically pass a control signal to the devices and send a message to one of 
any electronic controllers or interfaces provided in the devices. 
5 In accordance with a feature of the invention, the first registered control object in the system 
may be designated a manager object, which performs Ust management to maintain and 
administer the Ust of control objects by periodically broadcasting the Ust to all registered 
control objects on the system. The Ust contains the logical attributes, an identifier and an 
address of aU registered control objects on the system. The Identifiers are preferably globally 
10 unique random numbers generated at runtime, so as to identify each registered object "on-the- 
fly." This globally unique identifier may be also used with directed object-to-object 
communication, where a specific object must communicate with another specific object. 
Preferably, the random generator is a Unear congruential generator; i.e., f(z) = 16807 z mod 
(2**3M). 

15 In accordance with another feature of the present invention, the user interface is 

adapted to control the devices either locally or across the network. The user interface may 
also be adapted to control all of the devices that are functioning on the network via the control 
object. In addition, the user interface preferably supplies a coherent and transparent interface 
across all network media and topologies. Further, if the devices include a display by which 

20 the device may be controlled, in accordance with an aspect of the invention, the display may 
be adapted to control other devices via the network and the control objects. 

In accordance with an aspect of the present invention, a method of registering the 
control objects is provided, which includes broadcasting a control message from an enabled 
control object to inform other registered control objects that the enabled control object exists; 

25 determining if the enabled control object is a first registered control object; and appointing the - 
first registered object as a manager object to administer the list. 

The manager object may send the Ust to any new control object that registers with the 
system; periodically broadcast the list to all registered control objects; and perform a 
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synchronization to force all other control objects to synchronize to the list. An election 
process is held if the manager object ceases to function. The election process may comprise 
promoting a second registered control object to the manager object; promoting all other 
control objects up one position on the list; and distributing the Ust to all registered control 
5 objects on the system. If any other control object ceases to function, the Ust is preferably 
distributed to all registered control objects if any control object other than the manager object 
ceases to function. 

Other features of the invention are described below. 

BRIEF DESCRIPTION OF THE DRAWINGS 

10 

The foregoing summary, as well as the following detailed description of the preferred 
embodiments, is better understood when read in conjunction with the appended drawings. For 
the purpose of illustrating the invention, there is shown in the drawings an embodiment that is 
presently preferred, in which hke references numerals represent similar parts throughout the 
15 several views of the drawings, it being understood, however, that the invention is not limited 
to the specific methods and instrumentalities disclosed. In the drawings: 

Figure 1 is a block diagram representing a computer system in which aspects of the 
present invention may be incorporated; 

Figure 2 is an exemplary environment in which aspects of the present invention may 
20 be incorporated; 

Figure 3 is a block diagram illustrating the internal architecture of a control object of 
the present invention; 

Figure 4 is a block diagram illustrating the interaction of the control object with 
external software components, an operating system and physical transport media; 
25 Figure 5 is block diagram illustrating the relationship of list and object management, 

application programming interfaces, transport dynamically hnked libraries, physical media 
routines, and the physical media; 
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Figure 6 is a flowchart illustrating the process by which the control object registers 
with the system and how a manager object is appointed; 

Figure 7 illustrates an election process whereby a new manager object is appointed 
when an existing manager is removed from the system; 
5 Figure 8 illustrates an election process whereby a new manager object is appointed 

when a periodic message is not received from the manager object; and 

Figures 9A, 9B, lOA, lOB, 1 1 and 12 are exemplary Booch diagrams that express the 
static structure of the object classes, their internal structure, and the relationships in which 
they participate in a preferred embodiment of the system described above with regard to 
10 Figures 2-7. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention provides for a software system that may be irnplemented on any 
network infrastructure such that networked devices may be remotely controlled by, e.g., a 
15 general purpose computer, and a system whereby the networked devices may share 
information with and about each other. The present invention provides and accepts common 
command, control and communication through the network while retaining the abihty of each 
device to operate autonomously. 
Computer Environment 

20 Figure 1 and the following discussion are intended to provide a brief general 

description of a suitable computing environment in which the invention may be implemented. 
Although not required, the invention will be described in the general context of 
computer-executable instructions, such as program modules, being executed by a computer, 
such as a client workstation or a server. A more detailed description of the invention will be 

25 presented with reference to the home area network of Figure 2 and the description of the 
control object in Figures 3-12. 

Generally, program modules include routines, programs, objects, components, data 
structures and the Uke that perform particular tasks or implement particular abstract data 
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types. Moreover, those skilled in the art will appreciate that the invention may be practiced 
with other computer system configurations, including hand-held devices, multi-processor 
systems, microprocessor-based or programmable consumer electronics, network PCs, 
minicomputers, mainframe computers and the Uke. The invention may also be practiced in 
5 distributed computing environments where tasks are performed by remote processing devices 
that are Hnked through a communications network. In a distributed computing environment, 
program modules may be located in both local and remote memory storage devices. 

As shown in Figure 1, an exemplary system for implementing the invention includes a 
general purpose computing device in the form of a conventional personal computer 20 or the 

10 like, including a processing unit 21, a system memory 22, and a system bus 23 that couples 
various system components including the system memory to the processing unit 21. The 
system bus 23 may be any of several types of bus structures including a memory bus or 
memory controller, a peripheral bus, and a local bus using any of a variety of bus 
architectures. The system memory includes read-only memory (ROM) 24 and random access 

15 memory (RAM) 25. A basic input/output system 26 (BIOS), containing the basic routines that 
help to transfer information between elements within the personal computer 20, such as 
during start-up, is stored in ROM 24. The personal computer 20 may further include a hard 
disk drive 27 for reading from and writing to a hard disk, not shown, a magnetic disk drive 28 
for reading from or writing to a removable magnetic disk 29, and an optical disk drive 30 for 

20 reading from or writing to a removable optical disk 31 such as a CD-ROM or other optical 
media. The hard disk drive 27, magnetic disk drive 28, and optical disk drive 30 are connected 
to the system bus 23 by a hard disk drive interface 32, a magnetic disk drive interface 33, and 
an optical drive interface 34, respectively. The drives and their associated computer-readable 
media provide non-volatile storage of computer readable instructions, data structures, program 

25 modules and other data for the personal computer 20. Although the exemplary environment 
described herein employs a hard disk, a removable magnetic disk 29 and a removable optical 
disk 31, it should be appreciated by those skilled in the art that other types of computer 
readable media which can store data that is accessible by a computer, such as magnetic 
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cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access 
memories (RAMs), read-only memories (ROMs) and the like may also be used in the 
exemplary operating environment. 

A number of program modules may be stored on the hard disk, magnetic disk 29, 
5 optical disk 31, ROM 24 or RAM 25, including an operating system 35, one or more 
application programs 36, other program modules 37 and program data 38. A user may enter 
conomands and information into the personal computer 20 through input devices such as a 
keyboard 40 and pointing device 42. Other input devices (not shown) may include a 
microphone, joystick, game pad, satellite disk, scanner or the like. These and other input 

10 devices are often connected to the processing unit 21 through a serial port interface 46 that is 
coupled to the system bus, but may be connected by other interfaces, such as a parallel port, 
game port or imiversal serial bus (USB). A monitor 47 or other type of display device is also 
connected to the system bus 23 via an interface, such as a video adapter 48, In addition to the 
monitor 47, personal computers typically include other peripheral output devices (not shown), 

1 5 such as speakers and printers. 

The personal computer 20 may operate in a networked environment using logical 
connections to one or more remote computers, such as a remote computer 49. The remote 
computer 49 may be another personal computer, a server, a router, a network PC, a peer 
device or other common network node, and typically includes many or all of the elements 

20 described above relative to the personal computer 20, although only a memory storage device 
50 has been illustrated in Figure 1. The logical connections depicted in Figure 1 include a 
local area network (LAN) 51 and a wide area network (WAN) 52. Such networking 
environments are commonplace in offices, enterprise-wide computer networks, Intranets and 
the Internet. 

25 When used in a LAN networking environment, the personal computer 20 is connected 

to the local network 51 through a network interface or adapter 53. When used in a WAN 
networking environment, the personal computer 20 typically includes a modem 54 or other 
means for establishing communications over the wide area network 52, such as the Intemet. 



-9- 



MSFT-0021 
117834.1 



The modem 54, which may be internal or external, is connected to the system bus 23 via the 
serial port interface 46. In a networked environment, program modules depicted relative to the 
personal computer 20, or portions thereof, may be stored in the remote memory storage 
device. It will be appreciated that the network connections shown are exemplary and other 
5 means of estabhshing a communications link between the computers may be used. 

Home Area Network Environment Employing a Control Object and User Interface 
As noted, the computer 20 described above can be deployed as part of a computer 
network within which the system of the present invention may be implemented. In general, 
the above description appUes to both server computers and chent computers deployed in a 

10 network environment. As will become evident, the above description may also apply, in part, 
to appliances and devices attached to the network that have the ability to accept and execute 
software instructions. Figure 2 illustrates one such exemplary network environment in which 
the present invention may be employed. 

The present invention may be implemented in, for example, a household, a small 

15 office, or other similar environment. As illustrated, several devices are attached to the 
network 10 that may be controlled by users within the home or office. Such devices include, 
for example, a game device 112, a video device (VCR) 114, a telephone 116, a smart AC 
outlet 118, an answering machine 120, and a television 122, which may be connected to the 
network 10 as client devices. Other consumer devices, small office machines, and security 

20 devices may be connected to the network 1 0. 

Also connected to the network are general purpose computing devices that may 
control the above-identified devices 112-122. Such devices include a notebook (laptop) 
computer 49, a hand-held computing device 63, and a desktop PC/server 20. The notebook 
computer 49 preferably operates utihzing Windows® 95/98 or Windows NT® 4.0 

25 Workstation (or higher) operating systems. The hand-help computing device 63 preferably 
operates running Windows® CE 2.0 (or higher) operating system. The PC/Server 20 
preferably runs the Windows NT® 4,0 Workstation or Server (or higher) operating system. 
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As illustrated, the devices 20, 49, 63 and 1 12-122 are connected to a network medium 
136. The physical transport of the medium 136 is preferably Ethernet, since this topology is 
in ubiquitous use. However, the present invention is not limited to any particular physical 
network technology and may include fiber optic, X.IO, and serial. This system 10 preferably 
5 utihzes TCP and Intemet protocol (IP) as a common network layer, although it is not limited 
to the TCP/IP transport protocol, and the devices 20, 49, 63 and 112-122 are preferably 
identified by IP addresses. 

In accordance with the present invention, each of the above consumer devices 1 12-122 
is represented by a control object C01-C06. As will be described in greater detail below, the 

10 control objects C01-C06 are software objects designed to logically take on the physical 
attributes of devices 1 12-122 attached to the network 10. 

Although not shown in Figure 2, the devices 112-122 preferably include a 
microprocessor/microcontroller and a read-only memory containing an embedded operating 
system (e.g., Windows® CE 2.0 (or higher)). The embedded operating system and/or an 

1 5 apphcation running on the operating system serves to control the functions of the devices 1 12- 
122. The methods provided by the control objects CO (discussed below) may be executed by 
the operating system or the software application. It is preferable that the operating system of 
the devices include application programming interfaces (APIs) to enable each device's 
attendant control object CO to control the device based on the information contained within 

20 the control object CO. Such a structure would allows device manufacturers to use the control 
object CO, application software, and/or the device operating system to implement fimctions 
that would be appropriate for the manufacturer's specific device or service (e.g., providing 
play and record fimctions within the VCR 1 14). 

The present invention also provides for a user interface to allow users to interact and 

25 control the devices 112-122. The general purpose computing devices 20, 49 and 63 may act 
as the user interface or "consumer presentation displays" (CPD) 130, 132 and 134 to provide a 
coherent and transparent interface to users across all network media 136 and topologies. The 
user interface will be described in greater detail below. 
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Control Object Architecture and User Interface 
Control Object 

The control object and its operation within the network 10 will now be described in 
greater detail with reference to Figures 3-11. The control object CO logically represents the 
5 attributes of its associated physical device in order to provide for local and/or remote control 
of the device. The control object CO additionally maintains a Ust of other control objects CO 
registered on a given system such that any one control object may logically control any 
physical device connected to the system network. An exemplary implementation of the 
control object CO will now be described. 

10 The control object CO supports a layered software model that allows multiple 

transport layers to bind to the core object at runtime. The control object CO is preferably 
polymorphic, meaning that it can take on the logical attributes and command and control 
capabilities of any particular real- world device. The control object CO also is adapted to bind 
to any designed physical transport mechanism for communication with other control objects 

15 or control programs. The control object is further preferably capable of being embedded in a 
container application and/or executed within a wrapper executable. When the control objects 
C01-C06 are active, each carries out communication, accepts and issues control messages, 
contains data specific to the devices on the network, and allows a user to remotely control or 
query the physical device for which the specific control object CO has responsibility for 

20 maintaining logical connections and control. 

Figures 3 and 4 illustrate the inner architecture of the control object CO and the 
connectivity of the control object to a user interface 156, an operating system kemel 154, 
physical transport dynamically hnked libraries (DLLs) 152, and the physical medium 36. As 
a summary, the control object CO is preferably embodied as a Component Object Model 

25 (COM) object that exists within the operating system (e.g., Windows® 95/98, Windows NT®, 
Windows® CE) that calls transport DLLs 152 through well known medium neutral 
application programming interfaces (APIs) 170 to communicate via the network medium 36. 
The data and events to be communicated by the control object CO, are embodied as callbacks 
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and function (method) returns. Typically, the control object CO will load, activate, 
deactivate, and pass data to and from the transport. 

Turning to the exemplary embodiment, the control object CO includes a core 150 that 
has a COM interface to access the operating system kernel and COM services 154. The 
5 operating system kemel schedules activities (threads) for the computer processor to perform, 
and it handles interrupts and exceptions. If the computer has multiple processors, the kemel 
synchronizes activity among the processors to optimize performance. COM provides a binary 
standard for component interoperability by allowing any programming language that can call 
functions via pointers (e.g., C, C++, Small Talk®, Ada, and Basic) to interoperate with other 

10 components written to the same binary standard. The control object CO preferably utilizes 
COM services 154 and the associated interfaces, because the interfaces have predefined 
behaviors and responsibilities that allow applications to interact with each other and the 
operating system, are programming language-independent, and are provided on multiple 
platforms (e.g., Microsoft® Windows®, Microsoft® Windows NT®, Apple® Macintosh®, 

15 UNIX®). 

APIs 170 are called to translate to and from the transport^ DLLs 152 that provide for 
physical transport of information over the network medium 36. The APIs are a set of routines 
that request and carry out lower-level services performed by the operating system. In the case 
of Microsoft® Windows® operating systems, the APIs may also manage the application's 

20 windows, icons, menus, and dialog boxes. 

The transport DLLs 152 are reusable functions that can be called from other 
executable code. Under the Win32® model used in Microsoft® Windows® 95/98 and 
Windows NT®, the operating system maps the DLLs into the address space of a process when 
the process is starting up or while it is running. The process then executes the functions of the 

25 DLL. 

The control object core 150 also communicates to the user interface 156, which 
operates as the aforementioned consumer presentation display (CPD). The user interface 156 
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communicates with registered control objects COs for each of the physical devices 112-122 
connected to the media 36, A more detailed description of the CPD is provided below. 

The control object CO provides wrappers (container) 163 for exposed clients and 
enables use of method calls and exposed properties 166 that may be used by e.g., an operating 
5 system or other application software program. The wrapper 163 is provided to envelope (i.e., 
wrap) a call to a function or program inside another fimction or program. Methods and 
exposed properties 166 are logical operations provided by an object. In object-oriented 
programming, an object invokes a method by sending a message that contains the receiving 
object and the name of the specific method to invoke. Objects use messages as the 

10 mechanism through which they interact. Preferably, the methods are data neutral, in that they 
all take arguments of type VARIANT. Such typing allows the methods to be interoperable 
with Visual Basic, Delphi, and other ActiveX objects, as well as with C/C+H-, and applications 
such as Microsoft Internet Explorer (via HTML based scripting). An exemplary list of 
methods and exposed properties 166 available to the cUent container 164 are outlined in Table 

15 1 A below. 

TABLE lA 
Methods Exposed to the Ghent Container 



20 



25 



30 



STDMETHOD(GetAvailableData)(VARIANT *iPos, VARIANT *iLen, VARIANT *Data); 

This method allows a client to receive data after a "data available" event has 
been fired. 

STDMETHOD(Get06LastNode)(VARIANT *i); 

This method retrieves the position of the last CO in the global list (for 
enumeration). 

STDMETHOD(06Load)(short *i, BSTR bAnnounce, BSTR IP, short *Port); 

This method loads the object (and its transport DLL) and initializes input 
parameters. 
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STDMETH0D(Get06Member)(VARIANT *i, VARIANT *HOType, VARIANT * 
pAmiounce, VARIANT * bIP, VARIANT * iPort, VARIANT *iRand); 

This method allows a client to receive list information on any registered CO 
5 present on the network. 

STDMETHOD(get_MyPositionInQueue)(/*[out, retval]*/ VARIANT *pVal); 

This method (property) allows the chent to discover its position on the global 
10 list. 

STDMETHOD(get_bstrIP)(/*[out, retval]*/ VARIANT *pVal); 

This method (property) allows a client to receive its CO's IP or GUID. 

15 

STDMETHOD(get_ControlEnumType)(/*[out, retval]*/ VARIANT *pVal); 

This method (property) allows a client to discover it's own enumerated type. 
20 STDMETHOD(put_ControlEnumType)(/*[in]*/ short newVal); 

This method (property) allows a client to set its enimierated type. 
STDMETHOD(Deactivate)(); 

25 

This method allows a client to deactivate (deregister) the associated CO. 
STDMETHOD(Activate)(); 
30 This method allows a client to activate (register) the associated CO. 

STDMETHOD(SendData)(short *Pos, BSTR *Data); 

This method allows a client to send arbitrary data to another CO (client). 

35 

In general, when a COM object notifies its clients that something has happened, the 
COM object sends out a message. The message is called an event and the process of sending 
the message is referred to as "event firing." In accordance with the present invention. Table 
IB outhnes an exemplary list of methods (i.e., logical operations) that cause event firings on 
40 behalf of the cUent container 164. 
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TABLE IB 
Methods that Cause Event Firings 

STDMETHOD(Event_Activate)(); 

5 

The control object CO is activated. 
STDMETHOD(Event__Loaded)(); 
10 The control object CO is loaded and initiahzed. 

STDMETHOD (Event_DeActivate)(); 

The control object CO is deactivated and deregistered. 

15 

STDMETHOD (Event„DataAvail)(); 

There is incoming data available. 

20 The interaction between the control object CO and the transport DLLs 152 is 

illustrated in greater detail with reference to Figure 4 and Tables 2A and 2B below. As shown 
in Figure 4, Input and Output APIs 170a and 170b call transport DLLs that provide for core 
input and output management and the transport routines 152a and 152b. The APIs 170 and 
transport DLLs 152 are preferably provided by the operating system for the purpose of 

25 transporting data. The transport routines 152a and 152b, together with physical media 
routines 152c, provide access to the physical media 36 by providing the necessary transport 
protocol of the media (e.g., IP, serial, etc.). As noted above, the data and events that need to 
be communicated by the control object CO are embodied as callbacks and function (method) 
returns and the control object CO will typically need to load, activate, deactivate, and pass 

30 data to and from the transport. 

TABLE 2A 
Calls into the Transport DLL 

TYPEDEFS: 

35 
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typedef VOID * (WINAPIV* LPFNDLLFUNC1)(V0ID *, VOID *); 

typedef VOID * (WINAPIV* LPFNDLLFUNC2)(V0ID *,int *, int *,LPSTR,LPSTR,int *, 
int *); 

5 

typedef INT (WINAPIV* LPFNDLLFUNC3)(VOID *); 

typedef VOID (WINAPIV* LPFNDLLFUNC4)(V0ID *,int); 

1 0 typedef VOID (WINAPIV* LPFNDLLFUNC5)(V0ID *,LPSTR); 

typedef VOID * (WINAPIV* LPFNDLLFUNC6)(V0ID *,int *,int *, LPSTR); 

typedef VOID * (WINAPIV* LPFNDLLFUNC7)(V0ID *, VOID *, int i, LPSTR 
1 5 bAiinounce, LPSTR IP, int Port); 

typedef VOID * (WINAPIV* LPFNDLLFUNC8)(VOID *, int * i, int *j, LPSTR Data); 



20 TABLE 2B 

Transport Call Definitions 

extern "C" _declspec(dllexport) void * CPPLoad(void * uPtr, void * uPtrA, int i, LPSTR 
pAnnounce, LPSTR pIP, int Port) 

25 

Loads the Physically neutral part of the transport DLL routines, including 
linked list and object instantiation. Fires a "loaded" event when done. 

extern "C" declspec(dllexport) void * CPPActivate(void * uPtr, void * uPtrA) 

30 

Activates the physical transport. Fires an "activated" event when done. 

extern "C" declspec(dllexport) void * CPPDeactivate (void * uPtr, void * uPtrA) 

35 Unloads the physical transport, deregisters the object, and returns the object to 

a neutral state. 

extern "C" declspec(dllexport) void * CPPSendData (void *uPtr, int *i, int *iLen, LPSTR 

bPtrA) 

40 

Sends actual data to the transport DLL for relay to another CO on the network. 
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extern "C" __declspec(dllexport) void * Get06Member (void *uPtr, int *i, int LPSTR 
bPtrA, LPSTR 

5 Receives CO network member data based upon the member's position in the 

global list. 

extem "C" _declspec(dllexport) int GetControlEnmnType (void *uPtr) 
10 Retums the enumerated CO type (i.e. VCR, LIGHT, STEREO, etc.) 

extem "C" declspec(dllexport) void PutControlEnumType (void *uPtr, int i) 

Registers the enumerated CO type (i.e. VCR, LIGHT, STEREO, etc.) 

15 

extem "C" _declspec(dllexport) void GetIP (void *iiPtr, LPSTR bPtrA) 

Retums the IP address of the local object. If not IP based, this API retums a 
GUE) that is generated for the instantiation of the local object. 

20 

extem "C" declspec(dllexport) int GetPosition (void *uPtr) 

Retums the local object's position in the global list. 
25 extem "C" declspec(dllexport) int Get06LastNode (void *uPtr) 

Retums the maxima of the global hst. 
extem "C" __declspec(dllexport) void GetData (void *uPtr, int *iPos, int * iL, LPSTR uData) 

30 

Retums data that has been received from another CO, and a data-available 
event has been fired for. 

extem "C" void _cdecl SendDataToCUent(int i, int j, void * buff) 

35 

Callback for certain instances (architecturally) of the CO. It takes the place of a 
manual GET on the inbound data received from another CO. 

In addition to the control object's inter-communication capabilities provided by the 
40 APIs 170 and transport DLLs 152, the control objects CO in a system are capable of upper 
and lower edge control functions. Upper edge control functions include interaction with the 
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user interface 156, and lower edge control functions include interaction with the network 
media 36 and the devices 112-122. The control functions are related to the control object's 
logical representation of its associated physical device. In addition, by using extensions, a 
particular control object CO may logically and physically pass a control signal to a physical 
5 device directly, or send a message to the physical device's electronic controller or interface. 

Referring again to Figure 3, the control object CO also performs Hst management 162. 
List management is a feature of the invention whereby each control object CO maintains a Hst 
of its own state and the states of all other registered control objects existing in a live state on 
the network 10. An exemplary implementation of list management 162 is outline with respect 

10 to Figures 6 and 7. 

Referring to Figure 6, when a physical device 112-122 is first turned ON and 
functioning, its associated control object C01-C06 is enabled (S.lOO). The control object 
broadcasts a control message to inform other registered control objects that it exists (S.102). 
This will allow all other control objects within a given system to remain (or become) aware of 

15 each other's existence and world-state. If the control object CO is the first control object 
(S.104) to register with the system 10 (i.e., no other control objects are listed), the control 
object CO becomes a "manager object" (S.106). In addition to the control object's primary 
control duties with regard to the physical device it represents, the first control object CO (i.e., 
the manager object) maintains and administers a list of all other control objects. The list 

20 preferably contains an identifier (ED) and an IP address for each registered control object on 
the networked system 10. This feature makes the hst of control objects self-administering. 
• The identifiers are preferably globally unique random numbers generated at runtime, so as to 
identify each registered object "on-the-fly." This globally unique identifier may be also used 
with directed object-to-object communication, where a specific object must communicate with 

25 another specific object. Preferably, the random generator is a linear congruential generator; 
i.e., f(z) = 16807 z mod (2**31-1). 

The manager object responsibilities, however, are deliberately limited to allow each 
control object CO as much autonomy as it requires or is capable of having in view of the 
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device it is controlling. The manager object sends a copy of the world-state list to any new 
control object CO that registers with the system 10. Also, the manager object periodically 
broadcasts the list to registered control objects COs and performs a synchronization (i.e., takes 
a census) to force all other control objects to synchronize to the updated hst (S.108). 
5 The manager object position is an elected position and all control objects COs have the 

ability to become the manager object should the manager object be disconnected or otherwise 
unable to perform its duties (S.l 10). The election of a manager object preferably is performed 
as illustrated in Figure 7 (S . 1 1 2). 

Referring now to Figure 7, when the manager object (e.g., COl) drops out of the 

10 system 10, the second registered control object (C02) becomes the manager object. All other 
control objects move up one position on the hst (i.e., COS becomes C02; C04 becomes COS; 
and COS becomes C04, etc.) and a new hst is created. The newly created list is then 
replicated to all control objects on the system 10. However, if, for example control object 
C02 drops out of the system and control object COl remains, no election is held, but a new 

15 hst is replicated and passed to all registered control objects. As fixrther indicated in Figure 8, 
when a "heartbeat (i.e., a periodic message from the manager object indicating that the 
manager object is alive) is not provided from the manager object within the specified arbitrary 
time limit, the first device to timeout waiting for the manager heartbeat message will 
automatically elect itself manager and immediately send an updated list to all other objects. 

20 In the example of Figure 8, if the timeout period expires for Object 2 prior to a heartbeat being 
received from the manager object. Accordingly, Object 2 elects itself as manager object and 
informs the other objects by sending a new hst to all of the registered objects. This can mean, 
in cases where the manager is not actually inoperative, but rather just very busy, that manager 
object-related duties can pass to another registered object by way of default, rather than 

25 manager object failure. 

Referring back to Figure 6, after a new manager object is elected (S.l 12) and 
appointed as a manager object (S.l 14), the new manager object performs the duties discussed 
above with regard to S.108. It is noted that there are preferably cross checks to ensure that if 
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an manager object is rudely pulled out of service without a normal shut down message (e.g., 
its respective device ceases functioning without notice at S.llO), that the system 10 will 
perform the recovery election of Figure 7. This will ensure the immediate determination and 
election of a manager object and that newly promoted manager object will take a new census 
5 of the remaining objects such that each control object will have an up-to-date list of other 
control objects. 

Referring back to S.104, when the control object CO registering with the system 10 is 
not the first object, it receives a list of registered objects from the manager object and will 
respond to queries from the manager object or other objects (S.116) while in an active state. 

10 Each control object CO preferably provides information only if queried by another object. All 
subordinate objects receive a "heartbeat" message from the manager object. If the heartbeat is 
not sent to the subordinate object in a pre-determined amoixnt of time, the subordinate objects 
will automatically hold an election and one of these subordinates will become the manager (in 
the case where the manager object ceases to exist in a non-failsafe way). 

15 It is preferable that all control objects CO are peers in the system 10, and any 

physically dependent component that is less than a peer has a controller, which assumes the 
peer role. Further, when a physical device 112-122 is to be turned OFF and to cease 
functioning, it is preferable that the associated control object C01-C06 broadcast a message 
to inform other objects that it no longer exists and should be removed from the world-state 

20 hst. 

Each control object preferably will be able to query any other CO to retrieve the other 
CO's state, dependencies, and possible actions. If no response is received, the CO will be 
considered to have gone to sleep, which will cause the manager CO to rebuild and present a 
new list to the remaining COs. 
25 User Interface 

The user interface 156 (consumer presentation display 130, 132 and 134) enables a 
user to control all devices 112-122 attached to the network via registered and controllable 
control objects. The consumer presentation display 130, 132 and 134 (CPD) supphes a 
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coherent and transparent interface across all network media and topologies. This 
communication and control may be across a logical network or may be local to a particular 
physical device. The CPD takes on the personality of a physical device, for which the 
attendant control object CO carries out logical and physical mapping and control 
5 responsibihty. In the case of, e.g., the VCR 114, the CPD 130 contacts the VCR control 
object COS, queries the control object COS for capabilities and state information, and then 
presents a user with an appropriate display. The appropriate display in this example may 
include tape operation buttons and programming menus, which would be displayed by the 
CPD 130 on the laptop 49. That CPD would be capable of showing status for, and issuing 

10 commands to, the VCR 114 (through the registered control object COS), 

The CPDs 130, 132 and 134 are primarily expressed in this invention as a component 
of the upper-edge control mechanism. It is preferable that the operating system running on 
the laptop 49, pen computer (hand-held computer) 63, or desktop PC 20 contain a set of APIs 
to retrieve information from the control object CO and to generate the display of the CPD 130, 

IS 132 and 134. In addition, the CPD preferably uses HTML formatting techniques and may be 
programmed in Visual BASIC, C/C++, or other programming language. Information from a 
particular control object CO may be retrieved by calling the appropriate API, and based on the 
information retrieved, the CPD formats an appropriate screen for the user to control the 
device. 

20 Although the general purpose computing devices are shown as CPDs 130, 132, 134, it 

is noted that any device having display capabilities may act as a CPD. In particular, because 
the CPD retrieves information from the control objects C01-C06, and the control objects 
C01-C06 all perform list management 162 and are aware of their world-state and the world- 
state of all other objects, a display provided with, e.g., the game device 112 may be used to 

25 operate the video device 114. This feature is provided by the APIs included in the game 
device operating system or the software application controUing the game device 112, which 
enables the game device's attendant control object C06 to control the video device 114 based 
on the world-state hst information contained in the control object C06. The control object 
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C06 would communicate command and control information to the control object COS to 
accomplish physical control of the video device 114, Further, the display on the game device 
112 would be formatted to the personality of the VCR control display (i.e., display tape 
operation controls, etc.) in accordance with the world-state information. 
5 Figures 9A, 9B, lOA, lOB, 11 and 12 are exemplary Booch (class) diagrams that 

express the static structure of the object classes, their internal structure, and the relationships 
in which they participate in a preferred embodiment of the system described above with 
regard to Figures 2-7 in order to further provide one of skill in the art with a description of the 
present invention. It is noted that references in Figures 9A, 9B, lOA, 1 OB, 11 and 12 to a 

10 "home object" are references to the "control object" above. 

It is noted that the foregoing examples have been provided merely for the purpose of 
explanation and are in no way to be construed as limiting of the present invention. While the 
invention has been described with reference to preferred embodiments, it is understood that 
the words which have been used herein are words of description and illustration, rather than 

1 5 words of limitations. Further, although the invention has been described herein with reference 
to particular means, materials and embodiments, the invention is not intended to be limited to 
the particulars disclosed herein; rather, the invention extends to all functionally equivalent 
structures, methods and uses, such as are within the scope of the appended claims. Those 
skilled in the art, having the benefit of the teachings of this specification, may effect numerous 

20 modifications thereto and changes may be made without departing firom the scope and spirit 
of the invention in its aspects. 

For example, while the devices shown to be cUents and controllable by the CO have 
been illustrated as a game device, a video device, a telephone, a smart AC outlet, an 
answering machine, and a television, other devices may be controlled include, but not limited 

25 to personal computers, security systems, dishwashers, etc. In addition, other operating 
systems than the Microsoft® Windows® family may be provided with the appropriate APIs to 
implement the features of the invention. 
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WHAT IS CLAIMED : 

L In a network comprising a plurality of software controllable devices that 
communicate over said network, said software controllable devices including or coupled to a 
computer-readable storage medium, a distributed system for controlling said devices, 
5 comprising: 

at least one control object, said control object residing in said computer readable- 
medium accessible to a respective software controllable device and including logical attributes 
of said respective device, said control object accepting and issuing control messages to and 
from said respective device; and 

10 a user interface adapted to receive said control object, retrieve said logical attributes, 

and accept and issue control messages to and from said control object, said user interface 
residing in at least one of said software controllable devices, 

wherein when said control object is enabled, said control object registers with said 
distributed system, wherein said control object is active while said respective one of said 

15 devices is functioning, and wherein said control object maintains a Ust of all other registered 
control objects and their logical attributes. 

2. The system of claim 1, wherein said control object is adapted to bind to any 
designed physical transport mechanism for communication with other control objects. 

20 

3. The system of claim 1, wherein said control object is adapted to be embedded in a 
container apphcation and executed within a wrapper executable. 

4. The system of claim 1, wherein said software controllable devices each include an 
25 operating system, said operating system including application programming interfaces to 

retrieve data from, and write data to, said control object, and 
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wherein said control object control object is polymorphic such that said control object 
is adapted to take on the logical attributes and command and control capabilities of any of said 
devices, 

5 5. The system of claim 4, wherein said control object comprises a component object 

model (COM) object that exists within said operating system, said control object comprising a 
COM interface to access said operating system. 

6. The system of claim 4, wherein said control object provides wrappers for exposed 
10 cHents and enables use of method calls and exposed properties by said operating system or 

other application software program. 

7. The system of claim 4, wherein said control object utilizes transport DLLs provided 
by said operating system for transporting data between said devices. 

15 

8. The system of claim 1, wherein said control object further comprises extensions, 
wherein said control object is adapted to logically and physically pass a control signal to said 
software controllable devices, and wherein said control object is adapted to send a message to 
one of an electronic controller and interface provided in said software controllable devices. 

20 

9. The system of claim 1, wherein a first registered control object is designated a 
manager object, said manager object performing list management to maintain and administer 
said list by periodically broadcasting said list to all registered control objects on said system. 

25 10. The system of claim 9, wherein said list contains said logical attributes, an 

identifier and an address of all registered control objects on said system. 
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11. The system of claim 1, wherein said user interface is adapted to control said 
devices locally and to control said devices across said network. 

12. The system of claim 11, wherein said user interface is adapted to control all of 
5 said devices functioning on said network via said control object. 

13. The system of claim 11, wherein said user interface supplies a coherent and 
transparent interface across all network media and topologies, and wherein said user interface 
takes on the personaUty of said respective one of said physical devices for which said control 

10 object carries out logical and physical mapping and control responsibility. 

14. The system of claim 1, wherein said respective one of said physical devices 
further comprises a display by which said respective one of said physical devices is 
controlled, and wherein said display is adapted to control others of said devices via said 

15 network and said control object. 

15. In a system for controlling a plurality of software controllable devices represented 
by a plurality of control objects that maintain a hst of logical attributes of respective ones of 
said devices, said control object accepting and issuing control messages to and from said 

20 respective ones of said devices, a method of registering said control objects, comprising: 

broadcasting a control message from an enabled control object to inform other 
registered control objects that said enabled control object exists; 

determining if said enabled control object is a first registered control object; and 
appointing said first registered object as a manager object to administer said list. 

25 

16. The method as recited in claim 15, said manager object further: 
sending said list to any new control object that registers with said system; 
periodically broadcasting said list to all registered control objects; and 
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performing a synchronization to force all other control objects to synchronize to the 
said list. 

17. The method as recited in claim 15, wherein said list contains an identifier and an 
5 address for each registered control object on said system. 

18. The method as recited in claim 15, further comprising performing an election if 
said manager object ceases to function, said election comprising: 

promoting a second registered control object to said manager object; 
10 promoting all other control objects up one position on said hst; and 

distributing said list to all registered control objects on said system. 

19. The method as recited in claim 18, further comprising distributing said hst to all 
registered control objects if any control object other than said manager object ceases to 

15 function. 

20. In a network comprising a plurality of software controllable devices that 
communicate over said network, said software controllable devices containing a computer- 
readable storage medium within which information is stored, a system for controlling said 

20 devices, comprising: 

a plurality of control objects residing in said computer-readable mediimi of respective 

ones of said software controllable devices, said control objects including logical attributes of 

said respective ones of said devices, said control objects flirther accepting and issuing control 

messages to and from said respective ones of said devices, 
25 wherein said control objects register with said system and is active while said 

respective ones of said devices are functioning, and wherein said control objects maintain a 

hst of all other registered control objects and their logical attributes. 
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21. The system of claim 20, wherein said control objects are polymorphic such that 
said control objects are adapted to take on the logical attributes and command and control 
capabiUties of any of said devices, and wherein said control objects are adapted to bind to any 
designed physical transport mechanism for communication with other control objects, 

5 

22. The system of claim 21, said control objects further comprising extensions 
wherein said control objects are adapted to logically and physically pass a control signal to 
said devices, and wherein said control objects are adapted so send a message to one of an 
electronic controller and interface provided in said devices. 

10 

23. The system of claim 20, wherein said software controllable devices comprise an 
operating system, said operating system including application programming interfaces to 
retrieve data from and write data to said control object. 

15 24. The system of claim 20, wherein a first registered control object of said plurality 

of control objects is designated a manager object, said manager object performing list 
management to maintain and administer said Ust by periodically broadcasting said list to all 
registered control objects on said system, and wherein said list contains said logical attributes, 
an identifier and an address of all registered control objects on said system. 

20 

25. The system of claim 20, further comprising a user interface adapted to receive said 
control objects, retrieve said logical attributes, and accept and issue control messages to and 
from said control object, wherein said user interface is adapted to control said devices across 
said network and locally with respect to said respective one of said devices, 

25 

26. The system of claim 25, wherein said user interface supplies a coherent and 
transparent interface across all network media and topologies, and wherein said user interface 
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takes on the personality of said respective one of said physical devices for which said control 
objects carry out logical and physical mapping and control responsibility. 

27. The system of claim 20, wherein at least one of said physical devices further 
5 comprises a display by which said at least one of said physical devices is controlled, and 

wherein said display is adapted to control others of said devices via said network and said 
control objects. 

28. hi a network comprising at least one software controllable device that 
10 communicates over said network and is remotely controllable over said network, said software 

controllable device containing a computer-readable storage medium within which state 
information is stored, a system for controlling said device, comprising: 

a control object residing in said computer-readable storage medium, said control 
object including said state information of said device, said control object fiuther accepting and 
1 5 issuing control messages to and from said device, 

wherein said control object registers with said system and is active while said device is 
fimctioning, and wherein said control object maintain a hst of any other control object 
registered with said system and their logical attributes. 

20 29. The system of claim 28, wherein said control object is polymorphic such that said 

control object is adapted to take on the logical attributes and command and control 
capabilities of any device attached to said network, and wherein said control object is adapted 
to bind to any designed physical transport mechanism for communication with other control 
objects. 

25 

30. The system of claim 29, said control object further comprising extensions wherein 
said control object is adapted to logically and physically pass a control signal to said device, 
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and wherein said control object is adapted so send a message to one of an electronic controller 
and interface provided in said device. 

31. The system of claim 28, further comprising a user interface adapted to receive said 
5 control object^ retrieve said logical attributes, and accept and issue control messages to and 

from said control object, wherein said user interface is adapted to control said devices across 
said network and locally with respect to said device, 

32. The system of claim 31, wherein said user interface supphes a coherent and 
10 transparent interface across all network media and topologies, and wherein said user interface 

takes on the personality of said physical device for which said control object carries out 
logical and physical mapping and control responsibility. 
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ABSTRACT OF THE INVENTION 

A system for including a set of software components and an application programming 
interface for the logical networked representation and implementation of a system of smart 
devices within a home or small office environment. The software components include a 
control object component and a user interface component. The control object is a software 
object capable that carries out communication, accepts and issues control messages. The 
control object allows a user to remotely control or query a physical device for which the 
specific control object has responsibihty and for maintaining logical and physical connections 
and control of the device. The user interface supplies a coherent and transparent interface 
across all network media and topologies. The user interface is capable of communicating with 
any control object that it identifies as being controllable in a given system. The 
communication may be across a logical network or may be local to a particular device. The 
user interface takes on the "personality" of the physical device for which the attendant control 
object carries a logical and physical mapping and control responsibility. 
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becomes primary; C03- 
>C02, C04->C03, C05- 
>C04, then Replication of 
new list. 

If any other drops out, no 
election, just replication of 
new list. 
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HomeObject 



+m_fIsDirty BOOL = FALSE 
+nn_flsReady . BOOL 
+m_fList BOOL 
+m_endthread BOOL 

+nn_eType ' OBJTYPE 
+mJobjPos int = 0 
+mJBufler ' void* 
+m_OBuffer void* 
+m_buffer[512] • cfiar 
+UDPRand int 
+m_UpdateMsg UINT 
+m_nPort unsigned 
+m_nORand : int 
+nn_hSocket SOCKET = INVALID_SOCKET 

■»-nnJisten_socket_udp SOCKET 
+m_locai_udp - struct 
+m_£Vh HANDLE 

+nn_listen_socketJcp SOCKET 

+m_msgsock_tcp SOCKET 
+mjocal_tcp staict 
+m_EVh_udp HANDLE 
+m_EVh_tcp HANDLE 

*"U^KMd'-PSTR = NULL 

*m_CllpTO0- 

+m_Data Length int 
+m_pTCPData LPSTR 
+m_fOKtoSend BOOL = TRUE 
+m_Q.gj3[gpsij/)f(a,. int 



+nW^S^LEpWait 



+m_UDP 
+nn_TCP HANDLE 



+HomeObject() 
+~HomeObiect{} 
+ln!tHO(} BOOL 

+getKernelTransportEntry() • void * 

+setKerneiTransportEntry(void* Kptr) BOOL 

+GetMyControlListPosition{) . BOOL 

+SendTCPBuffer(int Pos, void* Buffer) BOOL 
■«-GoAway() BOOL 

+AllocBuffers(void* *l Buffer, void* *OBuffer, char* *TCPBuffer) BOOL 

^TO[^l§S^®/^^^'-^PSTR buffer) void 

+Stu1?^nng(char* buffer, int base, int num, OBJTYPE HOType. LPSTR szAnnounce, LPSTR strIP, ., 
+PickApart{char* buffer, int base, int* seqsize, int* indice, OBJTYPE* HOType, LPSTR szAnnounc 

+SendUDPData(ch^ buffer) void 
+GotUDPMessage(int len, LPSTR buffer) • void 
+GetHostAndPort(TCHAR* buff, int buffsize, unsigned int = *nP) BOOL 
+ConnectTCP{LPCTSTR IpszHostAddress, UINT nHostPort) BOOL 
+Write{void* pData, int nLen) int 
+getObjType() enum OBJTYPE 
Mn n ounce Myself 0 void 
+DoConnmand(CMDTYPE eCmd) BOOL 
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+m_pC06List 
01 



C06List 



#Num int 
#HOType OBJTYPE* 
#S2Announce LPSTR* 

#strIP ■ LPSTR* 

#nPort int* 

#n0Rand int* 

#N^f3^oid* 



SFode } 
#Head . C06Node* = NULL 



+C06List(int num, OBJTYPE HOType. LPSTR szAnnounce, LPSTR strlP, int nPort. int nORand) 
+C06List() 
+~C06List() 

+lnsertC06Node(int num, OBJTYPE HOType. LPSTR pszAnnounce, LPSTR strlP, int nPort, int nORand) . int 
+ChangeC06Num(int, int) int 
+DeleteC06Node(tnt. BOOL) int 
+GetFir$tC06Node() . int 
+GetLastC06Node() ' int 
+GetPrevC06Node{int) int 
+GetNextC06Node{int) int 

+SetC06Data(int num. OBJTYPE HOType, LPSTR szAnnounce, LPSTR strip, int nPort, int nORand) int 

+GetC06Data(int nunn, OBJTYPE* HOType. LPSTR szAnnounce, LPSTR strlP, int* nPort. int* nORand) int 
+ReindexC06Nodes() . int 
#LookUpC06Node(int) COSNode* 
#LookUpPrevC06Node(tnt) C06Node* 
#Ki[INode(C06Node*) • void 

#MakeNode{inf num, OBJTYPE HOType, LPSTR szAnnounce, LPSTR striP, int nPort, int nORand) C06Node* 
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Abstract 



#Nunn : int 

#HOType : OBJTYPE* 
#szAnnounce : LPSTR* 

#striP : LPSTR* 

#nPort : int* 

#nORand : int* 

#Next : void* 

#Prev : void* 

#C06Node : } 
#Head : COSNode* = NULL 



+C06List(int num, OBJTYPE HOType, LPSTR szAnnounce, LPSTR strIP, int nPort, int nORand) ; 
+C06List() : 
+--C06ListO : 

+lnsertC06Node(int num, OBJTYPE HOType, LPSTR pszAnnounce, LPSTR strIP, int nPort, int nOR... 
+ChangeC06Num(int, int) : int 
+DeleteC06Node(int, BOOL) . int 
+GetFirstC06Node() : int 
+GetLastC06Node() : int 
+GetPrevC06Node(int) : int 
+GetNextC06Node(int) : int 

+SetC06Data(int num, OBJTYPE HOType, LPSTR szAnnounce, LPSTR strIP, int nPort, int nORand)... 

+GetC06Data(int num, OBJTYPE* HOType. LPSTR szAnnounce, LPSTR strIP, int* nPort, int* nORa... 
+ReindexC06Nodes() : int 
#LookUpC06Node(int) : C06Node* 
#LookUpPrevC06Node(int) : C06Node* 
#KillNode(C06Node*) : void 

#IV)akeNode(int num, OBJTYPE HOType, LPSTR szAnnounce, LPSTR strlP, int nPort, int nORand) : ... 
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IDispatch 



Abstract 



CDV = CComDynamicUnkArray, piid, T 



+GetTypelnfoCount{unsigned* pn) : HRESULT 
+GetTypelnfo(uns(gned nTypelnfo, LCID Icid, ITypelnfo** ppTypelnfo) : HRESULT 

+GetlDsOfNames(REFllD riid, LPOLESTR* rgszNames, unsigned nNames, LCID Icid, DISPID* rgDispID) : HRESULT 
+lnvoke(DISPID dispidMember, REFIID nid, LCID Icid, WORD wFlags, DISPARMS* pDispParms, VARIANT* pvarResult... 




+GetTypelnfoCount(unsigned* pn) : HRESULT 



IDispatch 

Abstract 



+GetTypelnfo(unsigned nTypelnfo, LCID Icid, ITypelnfo** ppTypelnfo) : HRESULT 

+GetIDsOfNames(REFllD riid, LPOLESTR* rgszNames, unsigned nNames, LCID Icid, DISPID* rgDispID) : HRESULT 
+lnvoke(DISPID dispidMember, REFIID riid, LCID Icid, WORD wFlags, DISPARMS* pDfspParms, VARIANT* pvarResult, EXC. 




+get_Window{long* phwnd) : HRESULT 

+put_Valid(VARIANT_BOOL vbool) : HRESULT 

+get_Valid(VARIANT_BOOL* pbool) : HRESULT 
+Activate(void) : HRESULT 
+Deactivate(void) : HRESULT 

+get_ControlEnumType(VARIANT* pVal) : HRESULT 

+put_ControlEnumType(VARIANT* newVal) : HRESULT 
+get_bstrlP{VARIANT* pVal) : HRESULT 

+SendData(VARIANT* Pes, VARIANT* Data) : HRESULT 

+get_MyPositionlnQueue{VARIANT* pVal) : HRESULT 
+Get06Member(VAR!ANT* i, VARIANT* HOType, VARIANT* pAnnounc... 



FIG. 10B 





CDV = CComDynamicUnkArray, pud, T 


IConnectionPointlmpI 











1 

IConnectionPointlmpKT, &DIID__06Events, CComDynamicUnkArray> 



; / 




CProxy 06Events 








+Fire_Activated() : void 
+Fire„Deaci!vated() : void 
+Fire_DataAvail() : void 
+Fire_06Loaded() : void 
+Fire_06DataIn() : void 



H 

< 

c 
D 
o 



CD 



n 

u 
y 
y 
n 

r.; 

U 

P 
n 

rj 

U 



CO 

Q 

E 
o 
o 

O 



> 
Q 
O 



a. 
E 

c 
o 

c 
o 

O 
O 

c 
c 
o 
o 



A 
> 

< 

c 
o 
E 

(0 

c 

>^ 

Q 

E 
o 
o 
o 

c 
> 

UJ 
CO 

O 



O 

o6 

V 
Q. 

E 

c 
o 

Q. 

c 
o 

O 
0) 

c 
c 
o 
o 



c 
> 

UJ 

°^ 

o 

w 

o. 
o 




1 ""C I § ^ 

CO iS -J Q 

c3 O CO CD CD 

m' <d' <d' Cd' Cd' 

b= b: ^ ^ 

U_ U- L Li- L 

+ + + + + 



MSFT-0021/1 17834.1 

IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In Re Application of: 

Andrew C. Baird and Griffith Kadnier Group Art Unit: not yet 

assigned 

For: CONTROL OBJECT AND USER INTERFACE FOR 

CONTROLLING NETWORKED DEVICES Examiner: not yet assigned 



DECLARATION AND POWER OF ATTORNEY 



As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name; and 

I believe that I am the original, first and sole inventor (if only one name is listed below) or an 
original, first and joint inventor (if plural names are Ksted below) of the subject matter which 
is claimed and for which a 

Utility Patent d Design Patent 

is sought on the invention, whose title appears above, the specification of which: 

is attached hereto, 

was filed on as Serial No. . 

said application having been amended on . 

I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose to the U.S. Patent and Trademark Office all information 
known to be material to the patentability of this apphcation in accordance with 37 CFR § 
1.56. 

I hereby claim foreign priority benefits under 35 U.S.C. § 1 19(a-d) of any foreign 
application(s) for patent or inventor's certificate listed below and have also identified below 
any foreign application for patent or inventor's certificate having a fiUng date before that of 
any apphcation on which priority is claimed: 



□ 
□ 



Priority Country 

Claimed 

(IfX'd) 



-2- 
Serial Number 



Date Filed 



□ 
□ 
□ 



I hereby claim the benefit under 35 U.S.C. § 120 of any United States appUcation(s) listed 
below and, insofar as the subject matter of each of the claims of this application is not 
disclosed in the prior United States application in the manner provided by the first paragraph 
of 35 U.S.C. § 112, 1 acknowledge the duty to disclose to the U.S. Patent and Trademark 
Office all information known to be material to patentability as defined in 37 CFR § 1.56 
which became available between the fihng date of the prior application and the national or 
PCT international filing date of this apphcation: 

Serial Number Date Filed Patented/Pending/Abandoned 



I hereby claim the benefit under 35 U.S.C. § 1 19(e) of any United States provisional 
application(s) listed below: 



Serial Number Date Filed 



I hereby appoint the following persons as attomey(s) and/or agent(s) to prosecute this 
application and to transact all business in the Patent and Trademark Office connected 
therewith: 



Katie E. Sako 



Registration No. 32,628 



Daniel D. Grouse 



-3- 

Registration No. 32,022 



of MICROSOFT CORPORATION, One Microsoft Way, Redmond WA 98052 and 



Steven J. Rocci., Esq. Registration No. 30,489 

Lawrence A, Aaronson, Esq. Registration No. 38,369 

of WOODCOCK WASHBURN KURTZ MACKIEWICZ & NORRIS LLP, One Liberty 
Place - 46^^ Floor, Philadelphia, Pennsylvania 



Please address all telephone calls and correspondence to: 

Lawrence A. Aaronson, Esq. 
WOODCOCK WASHBURN KURTZ 
MACKIEWICZ & NORRIS LLP 

One Liberty Place - 46^^ Floor 
Philadelphia PA 19103 
Telephone: (215) 568-3100 

I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made 
are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the 
United States Code and that such willful false statements may jeopardize the validity of the 
appHcation or any patent issued thereon. 



Name: 




Andrew C. Baird 






Signature 




Date of Signature: 




Citizenship: U.S.A. 


Mailing Address: 


9208 NE 138th Place 




Kirkland, WA 98034 




City/State of Actual Residence: 




Kirkland, Washington 





-4- 



Name: 

Griffith Kadnier 






Signature ^'^^^^^^^^^ 

Date of Signature: l^jfj^^O^^ 
Citizenship: U.S.A. 


Mailing Address: 

14025 64'^ Avenue West 
Edmonds, WA 98026 


City/State of Actual Residence: 

Edmonds, Washington 





DOCKET NO. MSFT-0021/117834.1 



PATENT 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 
In Re Application of: 
Andrew C. Baird and Griffith Kadnier 



Serial No. : Not yet assigned 
Filed: herewith 

For: CONTROL OBJECT AND USER 

INTERFACE FOR CONTROLLING 
NETWORKED DEVICES 



Group Art Unit: not yet 
assigned 

Examiner: not yet assigned 



Assistant Commissioner for Patents 
Washington DC 20231 

Sir: 



ASSOCIATE POWER OF ATTORNEY 



The undersigned, of the firm WOODCOCK WASHBURN KURTZ 
MACKIEWICZ & NORRIS LLP, One Liberty Place - 46th Floor, Philadelphia, Pennsylvania 
1 9103, Attorney and/or Agents for Applicant(s), hereby appoints the following: 



Robert B. Washburn 
Richard E. Kurtz 
John J. Mackiewicz 
Norman L. Norris 
Albert W, Preston, Jr. 
Dale M. Heist 
Philip S. Johnson 
John W. Caldwell 
Gary H. Levin 
Dianne B. Elderkin 
Francis A. Paintin 
John P, DonohuCj Jr. 
Henrik D. Parker 
Suzanne E. Miller 
Lynn B. Morreale 
Mark DeLuca 
Joseph Lucci 
Michael P. Dminam 
Michael D. Stein 
Albert J. Marcellino 
David R. Bailey 
Doreen Yatko Trujillo 
Barbara L. MuUin 
Kevin M. Flannery 



Registration No. 16,574 Lynn A. Malinoski Registration No. 38,788 

Registration No. 19,263 Lori Y. Beardell Registration No. 34,293 

Registration No. 19,709 Michael P. Straher Registration No. 38,325 

Registration No. 24, 196 David A. Cherry Registration No. 35,099 

Registration No. 25,366 Anthony J. Rossi Registration No. 24,053 

Registration No. 28,425 Michael J. Swope Registration No. 38,041 

Registration No. 27,200 Michael J. Bonella Registration No. 4 1 ,628 

Registration No. 28,937 Harold H. Fullmer Registration No, 42,560 

Registration No. 28,734 William R. Richter Registration No. 43,879 

Registration No. 28,598 John E. McGlynn Registration No. 42,863 

Registration No. 19,386 Kimberly R. Hild Registration No, 39,224 

Registration No, 29,916 Lawrence A. Aaronson Registration No. 38,369 

Registration No. 3 1,863 Jonathan M. Waldman Registration No, 40,861 

Registration No. 32,279 Paul K. Legaard Registration No. 38,534 

Registration No. 32,842 Chad Ziegler Registration No. 44,273 

Registration No. 33,229 David N. Farsiou Registration No. 44, 104 

Registration No. 33,307 Maureen Gibbons Registration No. 44,121 

Registration No. 32,6 1 1 Steven H. Meyer Registration No. 37, 1 89 

Registration No. 34,734 John M. Paolino Registration No. 40,340 

Registration No. 34,664 Joseph R. Condo Registration No. 42,43 1 

Registration No. 35,057 Michael K. Jones Registration No. 4 1, 1 00 

Registration No. 35,719 Frank T. Carroll Registration No. 42,392 

Registration No. 38,250 Hans J. Crosby Registration No. P44,634 

Registration No. 35,871 Rena Patel Registration No. 41,412 



DOCKET NO. MSFT-0021/117834,1 



-2- 



PATENT 



Mark J. Rosen 



Registration No. 
Registration No. 
Registration No. 
Registration No. 
Registration No. 
Registration No. 



39,822 
38,394 
43,963 
43,243 
44,154 
41,126 



Mitchell R. Brustein 
Peter M. Ullman 



Thomas E. Watson 
Gregory L. Hillyer 
Maria M. Kourtakis 



his/her associates with full power to prosecute the above-identified application and to transact 
all business in the Patent Office connected therewith and requests that correspondence 
continue to be directed to the firm of WOODCOCK WASHBURN KLJRTZ MACKIEWICZ 
& NORRIS LLP at the above address, / / // 



Woodcock Washburn Kurtz 
Mackiewicz & Norris LLP 
One Liberty Place - 46th Floor 
Philadelphia PA 19103 
Telephone: (215) 568-3100 

Facsimile: (215) 568-3439 © 1997 WWKMN 



Date: June 24, 1999 




